🕷️️ Job Radar • SCRAPING

upwork.com 🟡 2026-05-10

🔹 Refactor raw job descriptions into structured Technical Manifest
👤 Client: 🇺🇸 USA Member since 2025-09-01
💰 Price: ****
🚩 Problem: Transform unstructured web scraping and data pipeline tasks into a structured JSON format for technical documentation.
📦 Existing: Not specified

Specifications:

[Target] Web scraping automation solution, news aggregation platform
[Method] Python, Scrapy / BeautifulSoup / Playwright, LLM API integration, Text classification, Data consolidation, Link validation, Cron / task scheduling
[UI/UX] Not applicable
[Stack] Python, Scrapy, BeautifulSoup, Playwright, LLM APIs, Text Classification Models, Link Validation Tools, Cron Jobs
[Security] Ensure data privacy and security during scraping and storage. Implement secure API integrations.
[Format] JSON

Workflow:

Analyze existing web scraping processes and document current state in JSON format.
Define technical specifications for each task (e.g., Python scripts, LLM models) and include them in the JSON manifest.
Outline monitoring and maintenance procedures to be included in the JSON documentation.